CLEARINGHOUSE  FOR  FEDERAL  SCIENTIFIC  AND  TECHNICAL  INFORMATION  CFSTI 

DOCUMENT  MANAGEMENT  BRANCH  410.11 


LIMITATIONS  IN  REPRODUCTION  QUALITY 


ACCESSION  » 


M  I .  WE  REGRET  THAT  LEGIBILITY  OF  THIS  DOCUMENT  IS  IN  PART 
UNSATISFACTORY.  REPRODUCTION  HAS  BEEN  MADE  FROM  BEST 
AVAILABLE  COPY. 


Q  2.  A  PORTION  OF  THE  ORIGINAL  DOCUMENT  CONTAINS  FINE  DETAIL 
WHICH  MAY  MAKE  READING  OF  PHOTOCOPY  DIFFICULT. 


n  3.  THE  ORIGINAL  DOCUMENT  CONTAINS  COLOR,  BUT  DISTRIBUTION 
COPIES  ARE  AVAILABLE  IN  BLACK-AND-WHITE  REPRODUCTION 
ONLY. 


Q  4.  THE  INITIAL  DISTRIBUTION  COPIES  CONTAIN  COLOR  WHICH  WILL 
BE  SHOWN  IN  BLACK-AND-WHITE  WHEN  IT  IS  NECESSARY  TO 
REPRINT. 


n  5.  LIMITED  SUPPLY  ON  HAND:  WHEN  EXHAUSTED.  DOCUMENT  WILL 
BE  AVAILABLE  IN  MICROFICHE  ONLY. 


n  6.  *.'VIITED  SUPPLY  ON  HAND:  WHEN  EXHAUSTED  DOCUMENT  WILL 
KuT  BE  AVAILABLE. 


Q  7.  DOCUMENTIS  AVAILABLE  IN  MICROFICHE  ONLY. 


Q  8.  DOCUMENT  AVAILABLE  ON  LOAN  FROM  CFSTI  (  TT  DOCUMENTS  ONLY). 


□  3. 


KN  1.-107-10/ 64 


PROCESSOR: 


DYNAMIC  PRCXIRAMMINO  AND 
MEAN  SQUARE  DEVIATION 


P-1147 
Rev.  ^l>-57 
-1- 

SUMMARY 

In  this  paper  we  wish  to  diacuae  aome  appllcatlona  of  the 
functional  equation  technique  of  dynamic  programming  to  the 
treatment  of  aome  quadratic  variational  problema  and  the  linear 
equationa  arlaing  therefrom. 

'Hie  firat  problem  we  ahall  conaider  ia  that  of  detemining 
the  minimuir  value  of  the  quadratic  deviation 

where  f(x)  ia  a  given  function  of  »  *  given 

sequence  of  real  functiona. 

Next  we  conaider  the  problem  of  minimizing  the  quadratic 

form 

■  Jo 

over  all  real  x^,  where  and  ^bj^J  are  given  real  se— 

quencea.  This  problem  arises  in  the  Kolmogoroff-Wlener  theory 
of  linear  predictors,  and  the  limiting  verrlon  of  the  problem, 

N  ■  00  ,  is  discussed  by  Levinson  in  the  appendix  to  Wiener's 
book. 

Finally  we  dlacuss  the  problem  of  solving  the  linear  syatom 
Ax  ■  b, 

under  the  assumption  that  A  Is  positive  definite. 
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Although  It  would  seem  that  In  all  three  cases  the  methods 
we  present  have  some  computational  utility,  we  shall  not  dis¬ 
cuss  these  matters  here,  since  at  the  moment  we  are  Interested 
only  In  the  purely  analytic  aspects  of  these  questions. 
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DYNAMIC  PROQRAMMINO  AND  MEAN  SQUARE  DEVIATION 

Richard  Bellman 


,  INTRODUCTION 

In  this  paper  we  wish  to  discuss  some  applications  of 
the  functional  equation  technique  of  dynamic  programming  [l] 
to  the  treatment  of  some  quadratic  variational  problems  and 
the  linear  equations  arising  therefrom. 

The  first  problem  we  shall  consider  is  that  of  deter¬ 
mining  the  minimum  value  of  the  quadratic  deviation 

where  f(x)  is  a  given  function  of 
sequence  of  real  functions. 

Next  we  consider  the  problem  of  minimizing  the  quad¬ 
ratic  form 

(2) 

over  all  real  where  |aj^|  and  are  given  real 

sequences.  This  problem  arises  In  the  Kolmogoroff-Wlener 
theory  of  linear  predictors,  and  the  limiting  version  of  the 
problem,  N  •  oo  ,  Is  discussed  by  Levinson  In  the  appendix 
to  Wiener's  book,  . 

Finally  we  discuss  the  problem  of  solving  the  linear 


)) 


a  given 


system 


I 
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(3)  Ax  -  b. 


under  the  assumption  that  A  la  positive  definite. 

Although  it  would  seem  that  In  all  three  cases  the 
methods  we  present  have  some  computational  utility »  we  shall 
not  discuss  these  matters  here,  since  at  the  moment  we  are 
Interested  only  In  the  purely  analytic  aspects  of  t^leoe 
questions. 


^2.  QUADRATIC  DEVIATION 

The  problem  of  minimizing  the  quadratic  form 

(1)  Vu)  (f 


dx 


is,  as  we  know,  quite  easily  resoluble.  Let  denote 

the  orthonormal  sequence  formed  from  by  means  of  the 

Qram^chmldt  orthogonallzatlon  procedure.  The  functions 
^j^(x)  are  assumed  to  be  linearly  Independent.  Then 

Min  Q,^(u)  -  Min  (f  - 
u  ^  y  0 


(2) 


y 

/^f^^dx-  I  (/^ff,dx)^ 
‘•0  lA  ‘'0 


f^dx  -  f (x)f (y)K^(x,y )dxdy, 

0  0  "0  ” 


where 

(3) 


K^Cx.y)  -  A^(x)/|^(y) 
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We  wish  to  obtain  a  recurrence  relation  for  K^(x,y)  with¬ 
out  going  through  the  orthogonallzatlon  procedure.  To  do  thla, 
we  Introduce  the  quadratic  functional 

(4)  F  (f)  -  Mln/'^  (f  -  2  N-1,  2,  ...  . 

^  u  0  k-1 

Then,  using  the  principle  of  optimality, 

(5)  Fj,(f)  -  Min  N  -  2,  3,  ...  . 

“n 


To  utilize  (5)»  we  use  the  knoK  fo.-Tm  of  F|^(f)  obtained  In 
(2)  above.  We  have 


Pj.(f)  -  Min 


(f-Uj,^j,)^dX  - 


(6) 


Min 


f^dx  -  Kj^i(x,y)f (x)f(y)dxdy 

0  0  0 


,>T  /’T 


( X )  f  ( y )  K|^j  ( X ,  y )  dxdy 


f^T  />T 


"n  [/”'  4'’*  KN_l(x,y)>fN{x)^„(y)<lxdyj 


It  Is  easily  seen  that  the  coefficient  of  Is  positive. 

'Wie  minimizing  value  Is  given  by 


(7) 


- 


'N 
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where,  to  simplify  the  notation,  we  have  set 


The  mlnlminn  value  Is  given  by 


(9) 


/’ 

/' 


f^dx  -  K^.  (x,y)f  (x)f(y)dxdy 

0  0 

^^(x)f(y)Kj^^(x,y)dxdy 


To  obtain  the  desired  relation  betwe'in  Kjj  and 
compare  (9)  and  (2),  and  equate  coefficients  of  f(x)f(y). 
CdT.'^elllng  the  term  J  f  dx,  the  result  Is 


Kjj(x,y)  -  K^^(x,y)  + 


l^n(x)(^^(y)  2^/’'^  ^^(z)K^j(z,y)d2dy 


+  ^^(z)^N(w)l^l(z,x)K^j(w,y)dzdw, 


a  nonlinear  Integral  equation. 

LINEAR  PREDICTORS 
Consider  the  quadratic 

and  tVie  sequence  defined  by 


fonn 

M 

N  >  M  >  1, 


(2) 


P-1147 
Rev.  9-1  >-57 
-5-- 


We  wish  to  determine  a  relation  between  and 

M-1  will  enable  us  to  compute  fjj  starting  with 

^N-M+1,1* 

Consider  the  function  of  N  +  1  real  variables 
Yqp  •••#  Yjj#  the  Integers  N  and  M  defined  by 

^  o 


(5) 


♦  (yN-*0®N-='l“N-l- 


where  the  sequences  |y^j  and  |a^|  are  given  and  the  minimi¬ 
zation  Is  over  the  x^.  In  order  for  the  problem  to  be  non¬ 
trivial,  we  assume  that  N  >  M  >  1. 

Let  us  now  obtain  a  recurrence  relation.  Assume  that  Xq 
has  been  chosen.  Then  the  quantities  x^,  x^,  Xj^  are  to 

be  chosen  to  minimize  the  remaining  sum 


(1) 


9  p 


This  minimum  Is  precisely,  in  accordance  with  the  notation 
Introduced  above. 


Hence  we  obtain  the  recurrence  relation 
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(6) 


,yj,j)  -  Min  [(yQ-^O^O^^ 
^0 


For  M  ■  1,  we  have 


(7) 


Min  [  2  (yk“^o^k)^^ 

Xq  x-u 


N 


N 


'j.'*  »&•«  >  -  'Av-'' 


^4 .  RECURRENCE  RriXATIONS 

In  order  to  use  (5*5)  to  determine  the  functions  fj^ 
In  a  more  constructive  fashion,  let  uo  observe  that  these 
functions  are  quadratic  forms  In  the  y^, 

N 


Substituting  In  (5.5), 


Cij(N.M)y^yj 


we  obtain  the  result 

-  Min  [(yo-XQao)^  + 
^‘0 


(2) 


^i-l 

1 J-0  i  j  ^ ^  ^  ^  ( y j^i-^0^ j 


Hence  Xq 


(5) 


Is  determined  by  the  relation 
N-1 

i,?-o 


and  we  have  the  relation 
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N  ,  ^  N-1  . 

li-o  -  Vo 

,  N-l  . 

r  N-l 

\,?.o 


Equating  coefficients  of  both  sides  of  this 

equation,  we  will  obtain  a  relation  for  c^j(N,M)  in  terms  of 
the  set  |c^j(N— l,Wt-l)}  .  Once  we  have  obtained  the  Oj^j(N,M), 
we  can  then  calculate  the  elements  of  the  minimizing  sequence 
using  (3)  repeatedly. 


the  equation  Ax  ■  b 

Let  US  now  sketch  the  application  of  the  same  techniques 
to  the  problem  of  solving  the  system  of  equations 


(1) 


j5.  'u’J 


y^,  i  -  1,  2, 


where  A  •  ^  positive  definite  matrix. 

Introduce  the  function  of  N  variables, 

for  N  -  1,  2,  ...,  -op<  y^^  ^®JL  relation 

N  N 

(2)  fji|(y2*y2*  *  *  *  *  Min  ^  2  Uj^jXj^Xj  —  2  y  • 

l,j“l  !•! 


V 
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To  obtAln  an  equation  for  f,  we  write 


-  2  ’'l(yi-“lK’'H'  -  ^’'n^N 


Once  Xj^  has  been  chosen.  It  is  clear  that  the  remaining 
x^,  1  “  1,  2,  ...,  1,  will  be  cl  osen  to  minimize  the 

expression 

N-1  N-1 

1,5-1  ^  1?1 

In  accordance  with,  the  above  notation,  this  minimum  Is 
precisely 

^N-l^yi"^lN^N»  y?"^2N^N»  ^rJ-l“^l-l,N^N^  * 

Hence,  we  obtain  the  recurrence  relation 

(6) 

•••'  yN_l“^N_l,N^;P  “■  ^  • 

In  order  to  use  this  relation  constructively,  vie  use  the 
fact  that  fj^  Is  a  quadratic  form  in  the 

N 

(T)  f y •  •  •  »yjj )  “  ^  i 

for  N  -  1,  2,  ...  . 


# 
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(8) 


Returning  to  equation  (6),  we  have  the  relation 
N  P 

l»J"l  ^ 


Collecting  terma  on  the  right,  we  have 

N  r  «  .  N-1 


(9) 


N-1 


*  li-i 


TTie  minimization  can  now  be  performed  readily  and  the  recurrence 
relations  connecting 

DISCUSSION 

The  method  discussed  above  might  be  particularly  useful 
In  connecting  with  the  problem  of  solving  an  Infinite  system 
of  equations  of  the  form 


(1) 


OD 


jil 


X,  -  b.,  1  -  1,  2,  ..., 


where  we  solve  succeeeively  the  finite  systems 


(2) 


N 


^Ij'^j  ‘  ^1'  ^  **'» 


to  obtain  approximations  to  the  solutions  of  (l). 
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